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Abstract. Infinite time Turing machines extend the operation of ordinary 
Turing machines into transfinite ordinal time. By doing so, they provide a 
natural model of infinitary computability, a theoretical setting for the anal- 
ysis of the power and limitations of supertask algorithms. 

Imagine that we have scaled the vertical asymptote of technological progress, 
as computers increase in speed each day, and that we have in our possession 
an infinitely fast computer. What would we do with it? What could we do 
with it? In order to make sense of these questions, we need a formal model of 
infinite computability, a mathematical description of the computing machines 
and of the algorithms that they will be able to carry out. In this article, I 
introduce such a model of infinitary computability by extending the classical 
Turing machine model into transfinite ordinal time; the resulting machines, 
infinite time Turing machines, are able to carry out and complete algorithms 
involving infinitely many computational steps. These computational steps 
proceed in time like the ordinal numbers, so that if the computation does not 
halt at any of the finite stages 0, 1, 2, 3, . . ., then it arrives at the first infinite 
stage uj, continuing with stages uj + 1, uj + 2, uj + 3, . . . and so on, eventually 
arriving at the second limit stage uj + uj, continuing with stages uj + uj + 1, 
uj + uj + 2, ... and so on through the ordinal numbers. The configuration 
of the machine at each stage is determined by the earlier configurations and 
the operation of the fixed finite program that the machine is running. These 
machines provide a robust model of infinitary computability, one that has 
shed light on the power and limitations of supertask computation. 

The essence of an infinitely fast computer, of course, is that it is able to 
complete infinitely many steps of computation in a finite amount of time. 
An infinitely fast computation, therefore, when measured by the number of 



computational steps in it, can be viewed (perhaps paradoxically) as being 
infinitely long. And indeed, since the logical fundamental unit of a computa- 
tion is the individual computation step, rather than the length of time that 
such a step takes to carry out, it may be more natural to view infinitely fast 
computations as being infinitely long. Therefore, in this article let us focus 
on the infinitely long computations, and take the term "infinite time" compu- 
tation, a term which might otherwise indicate a painfully slow computation, 
to suggest instead a lightening fast computation that actually completes all 
the steps in an infinite algorithm; the computational time is infinite when 
measured by the number of computational steps. 

1 Supertasks 

A supertask is a task involving infinitely many steps. Because any kind of in- 
finitary computation will naturally involve algorithms having infinitely many 
computational steps — supertask algorithms — the supertask concept seems to 
be central to any understanding of infinitary computability. So before intro- 
ducing the infinite time Turing machine model in the next section, with its 
explicit supertask notions of computability and decidability, let me first dis- 
cuss a few supertask examples more generally. 

Zeno of Elea (ca. 450 B.C.) was perhaps the first to grapple with the 
supertask concept in his famous paradoxical argument that it is impossible 
to go from here to there. Before arriving, one must first get halfway there, 
and before that one must get halfway to the halfway point, and so on, ad 
infinitum. Because one cannot accomplish these infinitely many tasks, Zeno 
argued, all motion is impossible. Thus, he takes the impossibility of com- 
pleting a supertask as the foundation of his reductio. 

In the twentieth century philosophical literature, the puzzles and para- 
doxes continue. Take Thomson's lamp (Thomson 1954), for example, which 
is on for 1/2 minute, off for 1/4 minute, on for 1/8 minute, and so on. After 
one minute (the sum of the series 1/2 + 1/4 + 1/8 + - - - ), is it on or off? The 
literature is full of answers. Another toy example is the super-7r machine, 
which writes out the successive digits of 7r on a tape, the first in 1/2 minute, 
the next in 1/4 minute, and so on, so that all the digits are written in a 
finite amount of time. Because there can be no last or final step in such a 
process, Chihara (1965) has criticized the completion of such an algorithm 
as unintelligible. 
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In a more entertaining example, 2 let's suppose that you have infinitely 
many one dollar bills (numbered 1, 3, 5, . . .) and upon entering a nefarious 
underground bar, you come upon the Devil sitting at a table piled high 
with money. You sit down, and the Devil explains to you that he has an 
attachment to your particular bills and is willing to pay you a premium to 
buy them from you. Specifically, he is willing to pay two dollars for each 
of your one-dollar bills. To carry out the exchange, he proposes an infinite 
series of transactions, in each of which he will hand over to you two dollars 
and take from you one dollar. The first transaction will take 1/2 hour, the 
second 1/4 hour, the third 1/8 hour, and so on, so that after one hour the 
entire exchange will be complete. The Devil takes a sip of whiskey while you 
mull it over; should you accept his proposal? Perhaps you think you will 
become richer, or perhaps you think with infinitely many bills it will make 
no difference? At the very least, you think, it will do no harm, and so the 
contract is signed and the procedure begins. How could the deal harm you? 

It appears initially that you have made a good bargain, because at every 
step of the transaction, he pays you two dollars and you give up only one. 
The Devil is very particular, however, about the order in which the bills 
are exchanged. The contract stipulates that in each sub-transaction he buys 
from you your lowest-numbered bill and pays you with higher-numbered bills. 
Thus, on the first transaction he accepts from you bill number 1, and pays 
you with bills numbered 2 and 4. On the next transaction he buys from you 
bill number 2 (which he had just paid you) and gives you bills numbered 
6 and 8. Next, he buys bill number 3 from you with bills 10 and 12, and 
so on. When all the exchanges are completed, what do you discover? You 
have no money left at all! The reason is that at the n th exchange, the Devil 
took from you bill number n, and never subsequently returned it to you. So 
while it seemed as though you were becoming no poorer with each exchange, 
in fact the final destination of every dollar bill in the transaction is under 
the Devil's ownership. The Devil is a shrewd banker, and you should have 
paid more attention to the details of the supertask transaction to which you 
agreed. And similarly, the point is that when we design supertask algorithms 
to solve mathematical questions, we must take care not to make inadvertent 
assumptions about what may be true only for finite algorithms. 

Supertasks have also been studied by the physicists. In classical mechan- 
ics under the Newtonian gravity law (neglecting relativity), it is possible to 
arrange finitely many stars in orbiting pairs, each pair orbiting the common 
center of mass of all the pairs, and a single tiny moon racing faster around, 
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squeezing just so between the dual stars so as to pick up speed with every 
such transaction. Assuming point masses (or collapsing stars to avoid colli- 
sion), the arrangement can be made to lead by Newton's law of gravitation 
to infinitely many revolutions in finite time. 

Other supertasks reveal apparent violations of the conservation of energy 
in Newtonian physics: imagine infinitely many billiard balls of successively 
diminishing size, converging to a point (see Laraudogoitia 1996). The balls 
are initially at rest, but then the first is set rolling. It collides with the next, 
transferring all its energy, and that ball begins to roll. Each ball in turn 
collides with the next, transferring all its energy. Because of the physical 
arrangements of the system, the motion disappears in a sense into the sin- 
gularity; after a finite amount of time all the collisions have taken place, and 
the balls are at rest. So we have described a physical process in which energy 
is conserved at each step, in every interaction, but not overall through time. 

Another arrangement has the balls spaced further and further out to 
infinity, pushing the singularity out to the point at infinity. The first ball 
knocks the second, which sends the next flying, and so on out to infinity. If 
the balls speed up sufficiently fast, under Newtonian rules it can be arranged 
that all the motion is completed in a finite amount of time. The interesting 
thing about this example and the previous one is that time-symmetry allows 
them to run in reverse, with static configurations of balls suddenly coming 
into motion without violating conservation of energy in any interaction. 

More computationally significant supertasks have been proposed by physi- 
cists in the context of relativity theory (Pitowsky 1990, Earman 1995, Ear- 
man, et. al. 1993, Hogarth 1992, Hogarth 1994). Suppose that you want 
to know the answer to some number theoretic conjecture, such as whether 
there are additional Fermat primes (primes of the form 2 2 " + 1), a conjec- 
ture that can be confirmed with a single numerical example. The way to 
solve the problem is to board a rocket, while setting your graduate students 
to work on earth looking for an example. While you fly faster and faster 
around the earth, your graduate students, and their graduate students and 
so on, continue the exhaustive search, with the agreement that if they ever 
find an example, they will send a radio signal up to the rocket. Meanwhile, 
by accelerating sufficiently fast towards the speed of light (but never exceed- 
ing it), it is possible to arrange that the relativistic time contraction on the 
rocket will mean that a finite amount of time on the rocket corresponds to an 
infinite amount of time on the earth. The point is therefore that by means 
of the communication between the two reference frames, what corresponds 
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to an infinite search can be completed in a finite amount of time. And it is 
precisely this ability to carry out such infinite searches — to go to the horizon 
and back in a finite amount of time — that will make infinite time Turing 
machines so powerful. 

With more complicated arrangements of rockets flying around rockets, 
one can solve more complicated number theoretic questions. Hogarth (1994) 
has explained how to determine in this way the truth of any arithmetic 
statement. More unusual relativistic Malament-Hogarth spacetimes can be 
(mathematically) constructed to avoid the unpleasantness of unbounded ac- 
celeration required in these rocket examples (see also Hogarth 1992, Pitowsky 
1990). 

These computational examples speak to a widely held strengthening of 
Church's thesis, namely, the view that the classical theory of computability 
has correctly captured the notion of what it means to be effectively com- 
putable. 3 Because the relativistic rocket examples provide algorithms for 
computing functions, such as the halting problem, that are not computable 
by Turing machines, one can view them as refuting this thesis. Supporters 
of this view emphasize that when thinking about what is in principle com- 
putable, we must attend to the computational power available to us as a 
consequence of the fact that we live in a relativistic or quantum-mechanical 
universe. To ignore this power is to pretend that we live in a Newtonian 
world. Other (perhaps less successful) arguments against the thesis appeal 
to the random or statistical nature of quantum mechanical phenomenon to 
mechanically produce non-computable bit-streams; this is possible even in 
Newtonian physics: a particle undergoing Brownian motion can be used to 
generate a random bit stream that we have no reason to think is recursive. 
Therefore, proponents argue, we have no reason to believe the strong form 
of Church's thesis. 

Apart from the question of what one can physically compute in this world, 
whether Newtonian or relativistic or quantum-mechanical, a mathematician 
can be interested in what in principle a supertask can accomplish. What 
are the mathematical limitations, as opposed to the physical inconveniences, 
of supertask computation? Which mathematical questions can and which 
cannot be answered via supertasks? To answer such questions, one needs a 
precise mathematical model of the supertask machines and the algorithms 
that they can carry out. One can then closely analyze the model and attempt 
to place the class of decidable sets, sets for which there is a computational 
procedure to decide whether a given object is a member of them or not, within 
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the known complexity hierarchies of descriptive set theory (which provide a 
way of measuring the complexity of various sets of natural numbers or reals 
in terms of the complexity of their definitions). The point is that such an 
abstract set-theoretic analysis can place severe bounds on the class of sets 
that can be computable: from below, we can hope to show that all sets at or 
below a given level of complexity are computable; from above, we can hope 
to show that no sets above a certain level of complexity are computable. The 
proximity of these bounds to each other speaks to the quality of the analysis, 
and precisely locates the supertask notion of computability within the larger 
(and intensely studied) hierarchy of complexity. 

Decades ago, Buchi (1962) and others initiated this kind of study at the 
lower levels of complexity, with the study of tu-automata and Buchi machines, 
involving automata and Turing machine computations of length u that accept 
or reject infinite input. The editor of this volume, Jack Copeland, has been 
particularly interested in the possibility of such machines completing their 
tasks in a finite amount of time, by accelerating the computation in time 
along a convergent series (e.g. the first operation takes 1/2 second, the next 
1/4 second, and so on), and has put forth a philosophical analysis of such 
accelerated Turing machines in various articles (see Copeland 1998a, 1998b, 
2002). Moving up in the hierarchy, Gerald Sacks and many others founded 
the field of higher recursion theory, including a-recursion and E'-recursion, 
a huge, deep body of work analyzing an abstract notion of computation on 
infinite objects (see Sacks 1990). 

In this article, I describe another model of infinitary computability, infi- 
nite time Turing machines, a model which offers the strong computational 
power of higher recursion theory while remaining very close in spirit to the 
computability concept of ordinary Turing machines. Infinite time Turing 
machines were originally defined by Jeff Kidder in 1989, and he and I worked 
out the early theory together while we were graduate students at the Uni- 
versity of California in Berkeley. Six years later, Andy Lewis and I solved 
some of the early questions and presented a complete introduction in a joint 
paper (appearing, finally, in 2000); in 1997 we solved Post's problem for su- 
pertasks (in press). Benedikt Loewe (2001), Dan Seabold (with myself, 2001) 
and especially Philip Welch (1999, 2000a, 2000b) have also made important 
contributions. The research is at an exciting early stage. 
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2 Infinite time Turing machines 



Infinite time Turing machines are obtained by extending the Turing machine 
concept to transfinite ordinal time. The idea is to allow a Turing machine 
to compute for infinitely many steps, preserving the information produced 
while doing so, and allowing the machine to continue with more computation 
afterwards. The individual computational steps will therefore be ordered like 
the ordinal numbers 0, 1, 2, 3, ... uj, uj + 1, uj + 2, . . . uj + uj, uj + uj + 1, 
... uj + uj + uj, ... and so on. After each stage a of computation there is a 
unique next stage a + 1, and these culminate in the limit ordinal stages, like 
uj, uj + uj, and so on. 

So let me explain specifically how the machines work. The machine hard- 
ware is identical to a classical Turing machine, with a head moving back and 
forth reading and writing zeros and ones on a tape according to the rigid in- 
structions of a finite program, with finitely many states. What is new is the 
transfinite behavior of the machine, behavior providing a natural theory of 
computation on the reals that directly generalizes the classical finite theory 
to the transfinite. 

For convenience, the machines have three tapes-one for the input, one for 
scratch work and one for the output-and the computation begins with the 
input written out on the input tape, with the head on the left-most cell in 
the start state. 



start 



input: 


1 


1 





1 


1 





scratch: 




















output: 





















Figure 1: An infinite time Turing machine — the computation begins 

The successive steps of computation proceed in exactly the classical man- 
ner: the head reads the contents of the cells on which it rests, reflects on its 
state and follows the instructions of the finite program it is running. Ac- 
cordingly, it writes on the tapes, moves the head one cell to the left or the 
right or not at all and switches to a new state. Thus, the classical procedure 
determines the configuration of the machine-the state of the machine, the 
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position of the head and the contents of the tapes- at any stage a + 1, given 
the configuration at any stage a. 

We extend the computation into transfinite ordinal time by simply spec- 
ifying the behavior of the machine at the limit ordinal stages, such as uj or 
uj + uj. When a classical Turing machine fails to halt, it is often thought 
of in contemporary computability theory as a sort of failure; the result is 
discarded even though the machine might have been writing some very inter- 
esting information on the tape, such as all the theorems of mathematics, for 
example, or the members of some other computably enumerable set. With 
infinite time Turing machines, however, we hope to preserve this information 
by taking some kind of limit of the earlier configurations and continuing the 
computation transfinitely. 



limit 



input: 
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1 
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scratch: 
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output: 
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1 





1 


1 


1 



Figure 2: The limit configuration 

Specifically, at any limit ordinal stage, the head resets to the left-most 
cell; the machine is placed in the special limit state, just another of the 
finitely many states; and the values in the cells of the tapes are updated 
by computing a kind of limit of the previous values that cell has displayed. 
Specifically, if the values in a cell have stabilized before a limit stage, then 
the limit value displayed by that cell at the limit stage will be this stabilized 
value; and otherwise, when the cell's value has alternated from to 1 and 
back again unboundedly often before a limit stage, then the limit value is 
set to 1. This limit value is equivalent, by definition, to computing for each 
cell what is called in mathematics the limit- supremum (the "lim sup" ) of the 
previous values displayed in that cell. (The model is robust in that if we use a 
limit value of in such cases, corresponding instead to the limit- infimum, an 
equivalent model of computability is obtained.) With the limit stage config- 
uration thus completely specified, the machine simply continues computing. 
If after some amount of time the halt state is reached, the machine gives as 
output whatever is written on the output tape. 
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input: 
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output: 


1 


1 
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1 



Figure 3: The computation ends, giving output 110101 • ■ ■ 

Because there seems to be no need to limit ourselves to finite input and 
output — the machines have plenty of time to consult the entire input tape 
and to write on the entire output tape before halting — the natural context 
for these machines is Cantor Space 2 U , the space of infinite binary sequences. 
For our purposes here, let's refer to such infinite binary sequences as real 
numbers. 4 

In this way, the machines provide a model of computation on the real 
numbers. Specifically, if p is a infinite time Turing machine program, then 
the function that p computes is determined by simply running an infinite 
time Turing machine with program p on whatever input is given, and giving 
as output the output of that computation. Such functions are said to be 
infinite time computable, or supertask computable. (Please note that since 
some computations never halt, even in the infinite time context, and so the 
domain of such a function need not include all real numbers.) A set of reals 
A is infinite time decidable, or supertask decidable, when its characteristic 
function, the function with value 1 for inputs in A and for inputs not in 
A, is supertask computable. The set A is infinite time semi- decidable when 
there is a program that halts with output 1 on exactly the inputs that are 
in A. (Thus, the semi-decidable sets correspond in the classical theory to 
the computably enumerable sets, though since here we have sets of reals, 
one hesitates to describe them as enumerable.) Since it is an easy matter 
to change any output value to 1, the semi-decidable sets are exactly the sets 
that are the domain of a computable function, just as in the classical theory. 

The first mathematical observation to make is that one need only consider 
countable ordinals (these are the ordinals that can be put into a one-to-one 
correspondence with a set of natural numbers, as opposed to the uncount- 
able ordinals, which cannot) when analyzing the computations of infinite 
time Turing machines. The fact is that every supertask computation either 
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halts or repeats in countably many steps. Let me explain in some mathe- 
matical detail why this is so. Suppose that a supertask computation has not 
halted in countably many steps; I will argue that it is caught in an endlessly 
repeating loop. By assumption, the computation proceeded through all the 
countable ordinals without halting, and finds itself at stage u>i, the first un- 
countable ordinal (the smallest ordinal having cardinality K^, without having 
yet halted. Consider the complete configuration of the machine — the position 
of the head, the state and the contents of the tape — at this stage. I claim 
that this configuration must have occurred earlier, and the machine is caught 
in an endlessly repeating loop. Since uj\ is a limit ordinal, we know that the 
head is on the left-most cell in the limit state, as it is at any limit ordinal 
stage. Further, any cell with a value of at stage uo\ must have been from 
some countable ordinal on, and since there are only countably many cells, 
there must be a countable ordinal stage ao by which all of those valued cells 
have stabilized. Let ct\ be a larger countable ordinal by which all the other 
cells have shown a value of 1 at least once, and a 2 be a still larger value by 
which all the remaining cells have shown a value of 1 once again, and so on. 
Let denote the first stage after all the stages an (this is still a countable 
ordinal). I claim that the configuration at stage « w is the same as it is at 
stage uj\\ since it is a limit ordinal, the head is on the first cell and in the 
limit state; and by construction the contents of each cell are computed in the 
same way that they are at stage u)\. Further, since beyond a the only cells 
that change are the ones that will change unboundedly often, by design, it 
follows that limits of this configuration are the very same configuration again, 
and the machine is caught in an endlessly repeating loop. (Please note that 
in the supertask context, a computation that merely repeats a complete ma- 
chine configuration is not necessarily caught in an endlessly repeating loop, 
for after u many repetitions, the limit configuration may allow it to escape. 
This is why one must consider the limits of the repeating configuration in 
the preceding argument. An example of this phenomenon is provided by the 
machine which does nothing at all except halt when it is in the limit state; 
this machine repeats its initial configuration many times, yet still escapes 
this repeating loop and halts at uo.) The conclusion is that any computation 
that fails to halt in countably many steps is doomed to repeat itself endlessly 
as the ordinals fall through the transfinite hourglass. 
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3 How powerful are the machines? 



One naturally wants to understand the power of the new machines. Since, of 
course, one needn't take advantage of the new powers the machine offers, any 
function that is computable by a classical Turing machine is computable by 
an infinite time Turing machine. But further, I claim that the infinite time 
Turing machines are strictly more powerful than their classical counterparts. 
Specifically, the halting problem for classical Turing machines — the question 
of whether a given program p halts on a given input n in finitely many steps, 
a problem well-known to be undecidable by classical Turing machines — is 
decidable in u many steps by infinite time Turing machines. To see this, 
one programs an infinite time Turing machine to simulate the operation of 
p on n, and if the simulated computation ever halts our algorithm gives 
the output that yes, indeed, the computation did halt. Otherwise, the limit 
state will be attained, and when this occurs the machine will know that the 
simulated computation failed to halt; so it outputs the answer that no, the 
computation did not halt. In this algorithm, it is as though the limit state 
exists specifically to tell the machine that the simulated computation did not 
yet halt. 

This argument generalizes to show that the infinite time Turing machines 
can decide membership in any given computably enumerable set A in u many 
steps. On input n, one simulates the classical enumeration of A; if n appears 
in the enumeration, give the output that yes, n is in A. Otherwise, when the 
limit state appears, give the output that no, n is not in A. 

The power of infinite time Turing machines, though, far exceeds the clas- 
sical halting problem and the computably enumerable sets. In fact, any 
question of first order number theory is supertask decidable. With an infi- 
nite time Turing machine, one could solve the prime pairs conjecture (which 
asserts that there are infinitely many prime pairs — pairs of primes, such as 
(11, 13) or (107, 109), which differ by two), for example, and the question of 
whether there are infinitely many Fermat primes (primes of the form 2 2 " + 1) 
and so on. With an infinite time Turing machine, one can decide the truth of 
any statement that is expressible in first order number theory (this includes 
essentially all of elementary number theory, all of finite combinatorics, all of 
finite graph theory, and so on). To decide a question of the form 3n<p(n, x), 
for example, where n ranges over the natural numbers, one can simply try 
out all the possible values of n in turn. One either finds a witness n or else 
knows at the limit that there is no such witness, and in this way decides 
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whether 3nip(n, x) is true. 

By analyzing this idea precisely, once concludes by induction on the com- 
plexity of the statement that any first order number theoretic question is 
decidable with only a finite number of limits, that is, before stage uj 2 (the 
limit of the sequence u, uj ■ 2, uj • 3, and so on). In fact, it is possible to prove 
that the class of sets that are decidable in time uniformly before uj 2 (meaning 
that for some n the program halts on all input before stage uj ■ n) is exactly 
the class of arithmetic sets, the sets of reals that are definable by a statement 
using first order quantifiers over the natural numbers (see Hamkins, et. al. 
2000, Theorem 2.6). 

Infinite time Turing machines, however, have a power that transcends 
even the full first order theory. In fact, their power reaches into the pro- 
jective hierarchy, in the second order theory (the projective sets are those 
that are definable using quantifiers not only over the natural numbers, but 
also over sets of natural numbers, or over the real numbers). One particular 
set, known as wo (for well-order, since it consists of the real numbers that 
code a well-ordered relation on the natural numbers, a relation having no 
infinite descending sequence), serves as a familiar sentinel or gate-keeper to 
these higher levels of complexity. Specifically, the set WO exists at what is 
called the Ii\ level of complexity, a level that subsumes all of the arithmetic 
hierarchy of first order number theory, as well as the hyperarithmetic sets (a 
kind a transfinite generalization of the arithmetic sets), and it is complete 
for this level of complexity in the sense that every other 11} set reduces to 
it. In this sense, WO is the hardest possible 11} set, and so to show that wo 
is supertask decidable, as I will do in the next paragraph, is to show that 
the infinite time Turing machines have power completely transcending the 
classical computability theory. 

With the reader's permission, let me sketch the argument showing that 
wo is decidable, using what Andy Lewis and I (2000) have called the "count- 
through" argument. The set WO consists of all reals coding a well-order 
relation on a subset of the natural numbers. (A real x codes a relation < 
on N in the sense that % < j if and only if the (i,j) th bit of x is 1, using the 
Godel pairing function (i, j), which associates pairs of natural numbers with 
individual natural numbers in a one-to-one correspondence. This function 
allows a binary relation to be coded with a binary sequence.) We would like 
to describe a supertask algorithm which on input x decides whether x codes 
a well-ordered relation < on a set of natural numbers or not, that is, whether 
x G wo or not. In uj many steps, it is easy to check whether x codes a linear 
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order: this amounts merely to checking that the relation < coded by x is 
transitive, irreflexive and connected. That is, the machine must check that 
whenever % < j and j < k then also % <k, that % < i never holds, and that for 
distinct % and j either i<j or j<i. All these requirements can be enumerated 
and checked in u many steps. Next, the algorithm will attempt to find the 
least element in the field of the relation <. This can be done by keeping a 
current-best-guess on the scratch tape and systematically looking for better 
guesses, whenever a new smaller element is found. When such a better guess 
is found, it replaces the current guess on the scratch tape, and a special flag 
cell is flashed on and then off again. At the limit, if the flag cell is on, it 
means that infinitely often the guess was changed, and so the relation has an 
infinite descending sequence. Thus, in this case the input is definitely not a 
well order and the computation can halt with a negative output. Conversely, 
if the flag cell is off, it means that the guess was only changed finitely often, 
and the machine has successfully found the <-least element. The algorithm 
now proceeds to erase all mention of this element from the field of the relation 
<, by turning the bits of a; to that mention it. This produces a new 
smaller relation, and the algorithm proceeds to find the least element of 
it. In this way, the relation < is eventually erased from the bottom as the 
computation proceeds. If the relation is not a well order, eventually the 
algorithm will erase the largest initial segment of it that is a well order, and 
then discover that there is no least element remaining, and reject the input. 
If the relation is a well order, then the algorithm will eventually erase the 
entire field, and recognize that it has done so, and accept the input as a well 
order. So in any case the algorithm can recognize whether x codes a well 
order or not, and so wo is supertask decidable. It follows, as I explained, that 
every set at or below the II \ level of complexity is also decidable. Because of 
this, the power of infinite time Turing machines is seen to reach into second 
order number theory, completely transcending the classical theory. 5 

Much of the classical computability theory generalizes to the supertask 
context of infinite time Turing machines. For example, the classical s-m-n 
theorem and the Recursion Theorem, for those who are familiar with them, 
go through with virtually identical proofs. But some other classical results, 
even very elementary ones, do not generalize. One surprising result, for 
example, is the fact that there is a non-computable function whose graph is 
semi-decidable. This follows from what Any Lewis and I (in our 2000 paper) 
have called the "Lost Melody Theorem," which asserts the existence of a real 
c which is not writable, so that it is not the output of any computation on 
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input 0, but such that the set {c} is decidable. Imagine the real c as the 
melody that you can recognize when someone sings it, but you cannot sing 
it on your own; so you can say yes or no whether a given object is c or not, 
thereby deciding the set {c}, but you cannot create c from scratch. If c is 
such a lost melody real, then let / be the function defined by f(x) = c. This 
function is total (defined on all input) and constant (has the same value for 
all input). The graph of the function consists of all pairs (x,f(x)), that is, 
of all pairs (x, y) for which y is c, and this is decidable. But the function is 
not computable because c is not writable. To summarize, the example shows 
that in the supertask context we have situation completely contrary to the 
classical computability theory: a non-computable function whose graph is 
semi-decidable; indeed, the example is all the more surprising because graph 
of the function / here is actually decidable, not merely semi-decidable, and 
what is more, the function is total and constant! There is nothing like this 
in the classical computability theory. 

4 How long are the computations? 

One naturally wants to understand how long a supertask computation can 
be. Therefore, I define an ordinal a to be dockable if there is a computation 
on input that takes exactly a many steps to complete (so that the a th step 
of computation is the act of moving to the halt state). Such a computation 
is a clock of sorts, a way to count exactly up to a. One sets the machine 
running, and when it halts it is as though an alarm clock has gone off: exactly 
a many steps have been computed. Such clocks are especially useful when 
it is desired to run some other computation for a given number of steps; one 
simulates the clock and the other computation simultaneously, and when the 
clock stops, the algorithm has computed the desired number of steps. 

It is very easy to see that any finite number n is dockable; one can 
simply have a machine cycle through n states and then halt. The ordinal u 
is dockable, by the machine that halts when it encounters the limit state. 
Similar ideas show that if a is dockable, then so is a + n and a + u. From 
this, it follows that every ordinal up to uj 2 is dockable. The ordinal oo 2 itself is 
dockable: one can recognize it as the first limit of limit ordinals, by flashing 
a cell on and then off again every time the limit state is encountered; the 
ordinal uo 2 will be first time this cell is on at a limit stage. Going beyond 
this, it is easy to see that if a and (5 are dockable, then so are a + (3 and 
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a(3. Students might enjoy finding algorithms to clock specific ordinals, such 
as w u + uj a , and I can recommend this as a way to help them understand 
the ordinals more deeply. 

Many readers will have guessed that the analysis extends much further, to 
much larger ordinals. In fact, any recursive ordinal is dockable. (A recursive 
ordinal is one whose order relation is isomorphic to recursive relation on the 
natural numbers. The supremum of the recursive ordinals, of which there 
are only countably many, is denoted cu^ , named for Church and Kleene.) 
This can be seen by optimizing the count-through argument I gave earlier 
when proving that WO is supertask decidable. Specifically, after writing 
on the tape in uj many steps a real that codes a given recursive ordinal, 
one proceeds to count through this ordinal by guessing the uj many least 
elements of the relation (while simultaneously erasing the previous guesses) , 
rather than handling only one guess with each limit. In this way, each block 
of uj many steps of the algorithm will erase uj many elements from the field 
of the relation, and the length of time the count-through procedure takes is 
more closely connected with the ordinal being counted. 

Some have been surprised that the dockable ordinals extend beyond the 
recursive ordinals, but in fact they extend well beyond the recursive ordi- 
nals. To see at least the beginnings of this, let me show that the ordinal 
ujf K + uj is dockable. By Feferman and Spector (1962), there is a recursive 
relation whose well-founded part has order type uj^ k . Consider the super- 
task algorithm that writes this relation on the tape and then attempts to 
count through it. By stage u>i K the non- well- founded part of the relation 
will have been reached, but it takes the algorithm an additional uj many steps 
to realize this. So it can halt at stage ujf K + uj. 

One is left to wonder, is uj± k itself dockable? More generally, Are there 
gaps in the dockable ordinals? After all, if a child can count to twenty- 
seven, then one might expect the child also to be able to count to any smaller 
number, such as nineteen. 6 The question is whether we expect the same to 
be true for infinite time Turing machines. 

The surprising fact is that there are gaps in the dockable ordinals. Let me 
give a brief sketch of this argument: Consider the algorithm which simultane- 
ously simulates all programs on input 0, recording which have halted; when 
a stage is found at which no programs halt, then halt. By construction, this 
algorithm verifies that a supertask algorithm can halt above a non-clockable 
ordinal, and so there are gaps in the dockable ordinals. The argument can 
be modified to show that the next gap above any dockable ordinal has length 



15 



to. Other arguments establish that complicated behavior can occur at lim- 
its of gaps, because the lengths of the gaps are unbounded in the dockable 
ordinals. 

An interesting question for future mathematical research would be to 
understand the structure of the dockable ordinals. For example, it is now 
known that no admissible ordinal can be dockable, and so the first gap occurs 
exactly at uj± k . Which is the next non-clockable ordinal? Can we find an 
independent characterization of the dockable ordinals? They do seem to 
arise very naturally in this theory. 

There is another way for infinite time Turing machines to operate as 
clocks, and this is by carefully using the count-through argument that I 
mentioned earlier. To assist with this analysis, we define that a real is writable 
if it is the output of a supertask computation on input 0. In analogy with 
the recursive ordinals, we define that an ordinal is writable if it is coded 
by a writable real. It is easy to see that there are no gaps in the writable 
ordinals, because if one can write down real coding a, it is an easy matter 
to write down from this a real coding any particular (3 < a. Andy Lewis 
and I (2000) proved that the order-types of the set of dockable ordinals and 
the set of writable ordinals are the same, but the question was left open 
as to whether these two classes of ordinals had the same supremum, that 
is, whether the two sets converged upwards to the same ordinal. This was 
solved affirmatively by Philip Welch (2000a), allowing Andy Lewis and I to 
greatly simplify arguments in our paper on Post's Problem. 

5 The supertask halting problems and jump 
operators 

Before discussing the supertask notions (and at the suggestion of the editor 
of this volume), let me spend several paragraphs giving an introduction to 
the elements of classical degree theory. Once having specified the operation 
of the classical Turing machines, one knows what it means for a function on 
the natural numbers to be computable and for a set of natural numbers to be 
decidable or computably enumerable (also known as recursively enumerable). 
The halting problem, the set of programs halting on a given input, then 
appears as a canonical example of a set that is computably enumerable but 
not decidable; indeed, it may be first concrete set many encounter that they 
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know definitively to be undecidable. The natural temptation arises to ask: 
Suppose you had some way of answering the halting problem, what then? 
With this set in hand, what could you compute from it? To answer, one 
develops the theory of oracle computation. Specifically, for a fixed set of 
natural numbers A, known as the oracle, one equips the Turing machine 
with an extra tape, the oracle tape, on which the membership information 
of A is explicitly written (the n th cell of the oracle tape is 1 when n is in A, 
otherwise 0). The functions that are computable with this expanded device 
are the functions that are computable relative to A, and one has a notion of 
a set being decidable or computably enumerable relative to A. 

The notion of relative computability reveals very quickly a vast mathe- 
matical structure lurking behind the scene: the Turing degrees. Specifically, 
one defines that A <t B (pronounced U A is Turing reducible to B") when A 
is decidable relative to oracle B, and this relation provides a way of measuring 
the relative complexity of sets; if A < T B, then B is at least as complicated 
as A. The two sets are Turing equivalent, written A = T B, when each oracle 
is computable relative to the other, that is, when A < T B and B A. 
If A is any set, then the degree of A is the equivalence class of A in this 
relation, the collection of all B such that A =t B. Any such B has the 
same information content as A, because with B we may reconstruct A and 
vice versa. The strict relation A < T B is defined to hold when A < T B but 
not A = T B. Two sets are incomparable (written A _L T B) when neither is 
computable from the other. 

The undecidability of the halting problem H means that <t H, where 
refers to the simplest possible set, the empty set, whose degree is the col- 
lection of all decidable sets. It is relatively easy to see that every computably 
enumerable set is decidable from H, and so the question remains, known as 
Post's Problem, whether there are any computably enumerable sets strictly 
between and HI That is, given the examples of the decidable sets and the 
various forms of the halting problem, which are all Turing equivalent, one 
might think that the only way to show that a given problem is undecidable is 
to reduce the halting problem to it. This would mean that every computably 
enumerable set is either decidable or equivalent to the halting problem, and 
there is nothing strictly between them. Post's Problem was solved by Fried- 
burg and Muchnik in 1956, however, with the opposite answer: with their 
finite injury priority argument method, one can construct a rich diversity of 
sets intermediate between and H (see Soare 1987). We now know that 
there is a rich structure of computably enumerable degrees; every countable 



17 



partial order, for example, finds an isomorphic copy in these degrees. 

It is surprisingly easy to lift the picture that we have of the degrees 
between and H to higher levels of the hierarchy, for the simple reason that 
most computability arguments relativize to the presence of a fixed oracle 
A. Thus, for example, the relativized halting problem H A , the set of all 
programs that halt on a given input with oracle A, is computably enumerable 
but not decidable relative to A. This observation provides a method of 
jumping higher in the degree structure: the Turing jump of a set A, written 
A' and pronounced "A-jump," is the halting problem relative to A, and 
by relativizing the undecidability of the halting problem, one knows that 
A < T A'. In this terminology, the classical halting problem H becomes 0', 
pronounced "0-jump". Faced with any operator, of course, one is tempted 
to iterate it, and doing so here produces an increasing sequence of degrees 
reaching upwards into the Turing hierarchy: <t 0' <t 0" <t 0"' <t • • • <t 
0W < T ■ ■ ■ and so on. One can ask all kinds of questions about the structure 
of the Turing degrees: Is every degree above 0' the jump of another degree? 
Yes. If the jumps of two sets are Turing equivalent, are the sets themselves 
equivalent? No. Are there undecidable degrees below 0' whose jump is still 
only 0'? Yes. Are there minimal non-computable degrees? Yes. Are the 
computably enumerable degrees dense, in the sense that whenever one is 
strictly less than another, then there is a third strictly in between? Yes. (For 
a textbook account of all these answers and much more, consult Soare 1987). 

Perhaps the broad philosophical view here is that each Turing degree 
represents a possible amount of information — this being precisely what is 
preserved by the Turing equivalence relation — and if we are interested in the 
structure of information, which I assume most readers of this volume are, it 
behooves us to understand the structure of the Turing degrees. 

This concludes my introduction to the theory of the classical Turing de- 
grees; let me now turn to the corresponding supertask model. Every new 
model of computation naturally also provides a corresponding new halting 
problem, the question whether a given computation halts. Thus, in the super- 
task context of infinite time Turing machines, we have the supertask halting 
problem. The full supertask halting problem H is the question of whether 
a given infinite time Turing machine program p halts on a given real input 
x. A special case of this problem is the weak halting problem h, which is 
the question of whether a given program p halts on the trivial input 0. The 
analogues of these two problems in the classical computability context are 
Turing equivalent and there is no big fuss made there distinguishing them, 
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but here in the supertask context the situation is somewhat subtler. 

The classical arguments directly generalize to show that the halting prob- 
lems h and H are semi-decidable but not decidable. First, for semi-decidability, 
the point is that given a program p and input x (or input 0), one can simply 
simulate p on x to see if it halts. If it does, output the answer that yes, it 
halted; otherwise, keep simulating. Second, for undecidability, let me give in 
the case of H the classical diagonalization argument. Suppose that H were 
decidable by an infinite time Turing machine, and consider the following al- 
gorithm: on input p, use the decision procedure for H to determine whether 
p halts on input p; if it does, then go into an infinite loop and never halt; 
if it does not, then halt immediately. This algorithm is infinite time com- 
putable by some program q. But observe that, by design, we have achieved 
the ubiquitous diagonal contradiction, namely, the program q halts on input 
q if and only if q does not halt on input q. So H cannot be decidable. The 
classical arguments also generalize to show that the weak halting problem h 
is also undecidable. 

Once one has introduced the halting problems, it is again natural to won- 
der what one could compute if one had some means to solve these problems, 
and one is led to the notion of oracle computation. There are, however, two 
natural types of oracles to use in the infinite time Turing machine context. 
On the one hand, one can use an individual real number as an oracle just as 
one does in the classical context, by simply adding an oracle tape containing 
this real number, and allowing the machine to access this tape during the 
computation. This corresponds exactly to adding an extra input tape and 
thinking of the oracle as a fixed additional input. 

But ultimately one realizes this is not the right type of oracle to consider, 
since an oracle is more properly the same type of object as one that might 
be decidable or semi-decidable, namely, a set of real numbers, not a mere 
individual real number. That is, with supertasks we have made the move to 
a higher-type theory of computability-with functions defined on sets of real 
numbers, rather than on sets of natural numbers-and we naturally want to 
develop our theory of relative computability at this level as well. Thus, we 
want somehow to allow a set of real numbers, such as the halting problem 
H, to become an oracle for the machines. And since such a set could be 
uncountable, and the set H in particular is definitely uncountable, we can't 
expect to be able to write out the entire contents of the oracle on an extra 
tape, as in the classical theory. Instead, we provide an oracle model of 
relative computability by which the machine can make membership queries 
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of the oracle. Specifically, for a fixed oracle set of reals A, we equip an infinite 
time Turing machine with an initially blank oracle tape on which the machine 
can read and write. The machine makes a membership query of A by writing 
out a real number a on the oracle tape, and then switching to a special query 
state; the result, however, is that the machine moves actually to the yes or no 
state, depending on whether a G A or not, and the algorithm has completed 
its query of A. In this way, the machine is able to ask, of any real a that 
it is capable of producing, whether a G A or not, and use the answer as 
the basis for more computation. This query model of oracle computation 
has proven robust. In the lower- type case of oracle sets of natural numbers, 
it is computationally equivalent to the usual oracle tape model in both the 
classical theory and the supertask theory here. And in the higher-type case 
of sets of reals, it closely follows the well-known definition in set theory of 
Godel's constructible universe L[A], relative to the predicate A, since when 
building this model, one is allowed to apply the predicate only to previously 
constructed objects, just as our oracle machines are only allowed to make 
queries of the form "is a G AT 1 for real numbers a that they are able to 
produce for the purpose. Queries, for example, of the form "is there a real 
y in the oracle having such-and-such property?" do not have the required 
form. 

From the notion of oracle computation, of course, just as in the classical 
theory, one obtains a notion of relative computability. Specifically, one set A 
is computable relative to another set B, if having B as an oracle allows one 
to decide membership in A, that is, if the characteristic of A is computable 
with oracle B. When this occurs, we write A <oo B, indicating that B is at 
least as complicated as A, and we say that A reduces to B. From this notion 
of relative computability, we can then define when two oracles are equivalent: 
A is equivalent to B, written A B, if and only if each is computable 
from the other, that is, A <oo B and B <oo A; the strict relation A <oo B 
is defined to hold if and only if A <oo B but not A =oo B. The equivalence 
classes of the equivalence relation =oo form the infinite time Turing degrees, 
namely, two sets have the same degree when they are equivalent to each other. 
When two sets are equivalent, they have the same information content, as 
far as supertask computation is concerned, because from either of them one 
can consruct the other. It is therefore in the structure of these degrees that 
nature of supertask computation is to be revealed; it is here that we will 
discover both the power and the limitations of supertask computation. 

The two halting problems give rise, of course, to two jump operators. 
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Specifically, for any set A we have the halting problem H relative to A, the 
question of whether a given program p halts on a given input x using oracle 
A. This problem is denoted by A J , pronounced A-jump, in analogy with the 
Turing jump. We also have the weak jump A v , obtained by adding to A the 
weak halting problem h relative to oracle A. The Jump Theorem asserts that 
for any set, A A v A J , and it is because of this theorem that we know 
that the two halting problems h and H are not equivalent. This is because 
h is equivalent to V and H is equivalent to T , and so since V <oo T , 
it follows that h <oo H. That is, h is computable from H but not vice 
versa. The Jump Theorem is generalized by the absorption property of the 
jump operators, namely, the fact that the strong jump absorbs applications 
of the weak jump, expressed by the equivalence A w =oo A y . This theorem 
shows that in a sense, the strong jump T jumps much higher than the weak 
jump V, as it means that A J is much higher in the degree structure than 
A y . In particular, it follows from the absorption property that A y cannot be 
equivalent to A T , since in that case A^ would be equivalent to A™, which by 
the Jump Theorem is strictly more complicated than A y . All these results 
are discussed at length in my paper with Andy Lewis (2000). 

6 Post's Problem for Supertasks 

Post's problem, the question in classical computability theory of whether 
there are non-decidable semi-decidable degrees other than the halting prob- 
lem, has a direct supertask analogue: Are there intermediate semi-decidable 
degrees between and the jump V ? 

The answer is delicately mixed. On the one hand, contrasting sharply 
with the classical theory in the context of degrees in the real numbers, we 
have a negative answer. The fact is that there are no real numbers z strictly 
in between and the jump V . Thus, while over the past fifty years the 
classical theory has supported an active, vibrant study of the computably 
enumerable degrees and indeed, of all the degrees between and the Turing 
jump 0', my theorem with Andy Lewis shows that in the context of supertask 
degrees of real numbers between and the jump V , there is simply nothing 
to study. 

Since this result is one of the strongest departures from the classical 
theory that has yet arisen, let me briefly sketch the proof. Suppose that z is 
a real number and <oo z <oo V . So z is the output of program p using V 
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as an oracle. Consider the algorithm that computes approximations to V by 
simultaneously simulating all programs on input and keeping track of which 
programs have halted. As these approximations to V are gradually revealed, 
the algorithm may use program p with them in an attempt to produce the 
real number z. All of the proper approximations to V are actually writable. 
If one of the proper approximations can successfully produce z, then z also 
is writable, and consequently =oo z. Conversely, if none of the proper 
approximations can produce z, then on input z we can recognize V as the true 
approximation, the first approximation able to produce z, and consequently 
z =00 V . So in no case can the real z be strictly in the middle. 

Nevertheless, despite this negative solution of Post's problem in the con- 
text of real degrees, there is a supertask analogue of the positive answer in 
the classical theory when it comes to sets of reals. Specifically, there is an 
oracle A, a set of reals, that is strictly in between and the jump V . Indeed, 
there are incomparable semi-decidable sets A _l_oo B (meaning that neither 
set is computable from an oracle for the other), and a rich structure of de- 
grees between and V . The argument generalizes the Friedburg-Munchnik 
priority argument (see Soare 1987) to the supertask context, much as Sacks 
did for a- recursion theory (see Sacks 1990). So the vibrant classical study of 
degrees between and the jump V that I mentioned earlier finds its analogue 
here, in the context of the degrees of sets of reals. 

Let me close this article by asking the broad questions: What is the struc- 
ture of the infinite time Turing degrees? To what extent do the properties of 
this structure mirror or differ from the classical structure? The field is wide 
open. 
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Notes 

1. My research has been supported in part by grants from the CUNY Research 
Foundation and the National Science Foundation. 

2. I heard a version of this example in an email exchange with Peter Vallentyne 
in March, 2001. 

3. The editor Jack Copeland has pointed out that Church and Turing put forth 
only the weaker thesis asserting that the functions computable by effective 
procedures that could in principle be carried out by a person with paper and 
pencil are Turing machine computable. 

4. While the binary expansion of a real number reveals a close connection 
between ordinary real numbers in the unit interval and infinite binary se- 
quences, they are not entirely equivalent, largely because the binary expan- 
sion of a real number may not be unique. For example, while 0.0111 • • • and 
0.1000 • • • are equal as real numbers, the sequences 0111 • • • and 1000 • • • are 
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distinct. We may regard the set of natural numbers as naturally included 
in the space of infinite binary sequences by identifying the number with 
the sequence 000 • • • , the number 1 with 100 • • • , the number 2 with 110 • • • , 
and so on. 

5. The exact complexity class of the decidable sets lies between \J H\ and 
A^, since every semi-decidable set has complexity A3,. The Arithmetic sets 
are exactly those that are uniformly decidable with a finite number of limits, 
that is, before uj 2 , and the hyperarithmetic sets, the A} sets, are exactly 
the sets which can be decided in some bounded recursive ordinal length of 
time, uniformly before . The class A2 is known to be closed under 
the supertask jump operators, so there is a very rich supertask complexity 
hierarchy entirely contained within A?j. 

6. Friends with children have informed me that such an expectation is unwar- 
ranted; one sometimes can't get the child to stop at the right time. This 
reminds me of a time when my younger brother was in kindergarten, the 
children all sat in a big circle taking turns saying the next letter of the al- 
phabet: A, B, C, and so on, around the circle in the manner of the usual 
children's song (evidently an American phenomenon). After the letter K, 
the next child contributed LMNOP, thinking that this was only one letter. 
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